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on a backward image of one's own vehicle taken by a 
CCD camera and displayed on a screen of a display A 
mobile locus including a marker G of one's own vehicle 
a marker a parking path, and a current position is dis- 
played on the top plane creating image in a duplicate 
way. 
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Description 

BACKGROUND OF THE INVENTION 

1. Field of Invention 

[0001] The present invention relates to a parking as- 
sist system for assisting parking operation of a driver by 
using a picture image displayed on a screen. 

2. Description of Related Art 

[0002] Conventionally, there is a "backward supervi- 
sory monitor system of a vehicle" which is described in 
a Japanese Patent Laid-Open Publication No. SHOWA 
59-114139, for example, as a parking assist system for 
assisting parking operation using a picture image dis- 
played on a screen. For the backward direction of one's 
own vehicie, such a "backward supervisory monitor sys- 
tem of a vehicle" stores in beforehand a marker position 
data corresponding to rudder angle data of a tire, re- 
trieves the marker position data corresponding to the 
rudder angle data if the rudder angle data are input from 
a tire direction sensor, and displays a marker column on 
the screen of a monitor display in which the backward 
portion of one's own vehicle is displayed. 
[0003] That is to say, as shown in FIGS. 10(a), (b), 
and (c) , the markers 1 01 which are biased along an an- 
ticipated backward course of one's own vehicle as well 
as an obstacle (a parked vehicle 1 02 in FIG. 1 0) are dis- 
played on a screen 1 00 of the monitor display close to 
a driver's seat, and the backward direction of one s own 
vehicle is Indicated clearly, thus It comes tc possible to 
reduce a burden of driving for parking at the time of 
putting into the garage, column parking, and so forth. 
[0004] However, for seeing a picture image displayed 
in the screen 100 of the monitor display and seeing di- 
rectly with the naked eye, the senses of feeling the dis- 
tance do not work in the same way. Further, since the 
picture image displayed on the screen 100 of the mon- 
itor display is the picture image from a point of view of 
a camera which is set in the backward direction of one's 
own vehicle, there is a limitation for the range of seeing 
through the picture image displayed in the screen 100 
of the monitor display. Further, when it is started parking 
operation by moving back after stopping steering, for ex- 
ample, the direction of the picture image which is shown 
in the screen 1 00 of the monitor display changes as the 
direction of one's own vehicle changes. In this way, in 
the conventional "backward supervisory monitor system 
of -a- vehlete, M -ft t*as -net-been-easy ts ^ confirm *£s f©is- 
tionship (the distance, angle, etc, to one's own vehicle) 
between relative positions to such an obstacle as a 
parked vehicle, a road shoulder, a guardrail, a wall, and 
an electric poll from the picture image of the screen 1 00 
of the monitor display. 

[0005] Forthat reason, the present invention is invent- 
ed to solve above-mentioned problems. In the parking 



assist system, it is an object of the present invention to 
make it easy for a driver to confirm the relationship be- 
tween relative positions to the obstacle and one's own 
vehicle. 

5 

SUMMARY OF THE INVENTION 

[0006] One of the aspect of the present invention is 
characterized in that a parking assist system for display- 
's ing an anticipated course calculated from a steering rud- 
der angle of one's own vehicle on a picture image in a 
duplicate way in which a circumstance situation of one's 
own vehicle is displayed, includes image creating 
means for creating a top plane creating image based on 
15 the aforementioned picture image in which the afore- 
mentioned circumstance situation is indicated from a 
point of upward view, first input means for inputting a 
parking target point which one's own vehicle targets 
based on the aforementioned picture image, first calcu- 
zo lating means for calculating a parking path from a cur- 
rent position of one's own vehicie to the aforementioned 
parking target point, and displaying means for display- 
ing the aforementioned parking path on the aforemen- 
tioned top plane creating image in a duplicate way. 
25 [0007] That is to say, in the parking assist system of 
the present invention, while the image creating means 
creates the top plane creating image, in which the cir- 
cumstance situation of one's own vehicle is indicated 
from a point of upward view, is created based on the 
30 picture image in which the circumstance situation of 
one's own vehicle is taken, since the parking path of 
one's own vehicle is displayed in the top plane creating 
Imege in a duplicate way by the displaying means ^ti a r 
the first calculating means calculates the parking path 
35 from the current position of one's own vehicle to the 
parking target point if the parking target point, in which 
one's own vehicle is preferably parked, is input by the 
first calculating means, it is possible to confirm or grasp 
more easily the relationship between relative positions 
to the obstacles. 

[0008] Another aspect of the parking assist system 
according to the invention, the aforementioned image 
creating means updates the aforementioned top plane 
creating image based on a change of the aforemen- 
tioned picture image caused by one's own vehicle's 
moving. 

[0009] That is to say, in the parking assist system of 
the present invention, when one's own vehicle moves, 
based on the change of the picture image due to one's 
own vehicle's moving, if the image creating means up- 
datGS4r^ top p^ans GToatir^ image sr^ further if ths dis- 
playing means displays the parking path of one's own 
vehicle in a duplicate way for the updated top plane cre- 
ating image, the top plane creating image, in which the 
circumstance situation of one's own vehicle is indicated 
from a point of upward view, is replaced with the image 
in accordance with the current situation, thus it comes 
to be possible to grasp more easily the relationship be- 
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tween relative positions to the obstacles. 
[0010] Further aspect of the parking assist system ac- 
cording to the invention, the aforementioned one's own 
vehicle includes a second input means for inputting an 
avoidance point which the aforementioned one's own 
vehicle avoids and the aforementioned first calculating 
means calculates a parking path to the aforementioned 
parking target point by avoiding the aforementioned 
avoidance point. 

[0011] Further, in the parking assist system of the 
present invention, if the first calculating means calcu- 
lates the parking path by considering the avoidance 
point which is input by the second input means, the park- 
ing path becomes the path in which the avoiding point 
which one's own vehicle preferably avoids at the time of 
driving for parking is considered, thus enabling the con- 
firmation more easily of the relationship between rela- 
tive positions to the obstacles. 

[001 2] Further aspect of the parking assist system ac- 
cording to the invention, a second calculating means for 
calculating a mobile locus of the aforementioned one's 
own vehicle is further included and the aforementioned 
displaying means displays the aforementioned mobile 
locus on the aforementioned top plane creating image 
in a duplicate way. 

[0013] Further, in the parking assist system of the 
present invention, if the second calculating means cal- 
culates the mobile locus of one's own vehicle and further 
if the displaying means displays the mobile locus in a 
duplicate way for the top plane creating image, the mo- 
bile locus of one's own vehicle is displayed in addition 
to the parking path of one's own vehicle in the top plane 
creating image in which the circumstance situation of 
one's own vehicle is indicated from a point of upward 
view and it is possible to recognize the difference be- 
tween the parking path of one's own vehicle and the mo- 
bile path of one's own vehicle, thus it comes to be pos- 
sible to grasp more easily the relationship between rel- 
ative positions to the obstacles. 

[0014] Further aspect of the parking assist system ac- 
cording to the invention, the aforementioned displaying 
means displays a current position of the aforementioned 
one's own vehicle by incorporating with the aforemen- 
tioned mobile locus. 

[0015] Further, in the parking assist system of the 
present invention, in the case that the displaying means 
displays the current position of one's own vehicle by be- 
ing incorporated with the mobile locus of one's own ve- 
hicle, it is possible by taking a look to recognize the dis- 
tance from the obstacles at the present time to one's 
own vehicle and the angle of one's own vehicle towards 
the obstacles at the present time, thus it comes to be 
possible to grasp more easily the relationship between 
relative positions to the obstacles. 
[001 6] Further aspect of the parking assist system ac- 
cording to the invention, an image processing means for 
converting to a top plane converting image in which the 
aforementioned picture image is viewed from a point of 



upward view is included and the aforementioned dis- 
playing means displays the aforementioned top plane 
converting image instead of the aforementioned top 
plane creating image. 
5 The invention further characterized in that the 

parking assist system includes an image processing 
means for converting to a top plane converting image in 
which the aforementioned picture image is viewed from 
a point of upward view and the aforementioned display- 
io ing means displays by means of a combination of the 
aforementioned top plane creating image and the afore- 
mentioned top plane converting image. 
[0017] Further, in the parking assist system of the 
present invention, the image processing means for con- 
's verting into top plane converting image in which the pic- 
ture image is viewed from a point of upward view is in- 
cluded, in the case that the displaying means displays 
the top plane converting image instead of the top plane 
creating image or displays by means of a combination 
20 of the top plane creating image and the top plane con- 
verting image, the image is converted into the top plane 
converting image in which the whole or a part of the top 
plane creating image in which the circumstance situa- 
tion of one's own vehicle is indicated from a point of up- 
25 ward view is a real picture image, it is possible to replace 
a part or the whole of the top plane creating image in 
which the circumstance situation of one's own vehicle 
is indicated from a point of upward view, thus it comes 
to be possible to grasp more easily the relationship be- 
30 tween relative positions to the obstacles. 

[001 8] Further aspect of the parking assist system ac- 
cording to the invention, the aforementioned displaying 
means displays the aforementioned top plane creating 
image and the aforementioned picture image simulta- 
35 neously by splitting a screen. 

[0019] The aforementioned displaying means dis- 
plays the aforementioned top plane creating image and 
the aforementioned picture image or displays the afore- 
mentioned picture image and a combined image of the 
40 aforementioned top plane creating image and the afore- 
mentioned top plane converting image simultaneously 
by splitting the screen. 

[0020] Further, in the parking assist system of the 
present invention , in the case that the displaying means 
^5 displays the image as well as the top plane creating im- 
age at the same time by splitting the screen or in the 
case that the picture image and a combined image of 
the top plane creating image and the top plane convert- 
ing image are displayed at the same time by splitting the 
50 screen, it is possible to see the image for inputting the 
parking target point and the avoidance point and the im- 
age in which the anticipated course calculated from the 
steering rudder angle of one's own vehicle is displayed 
in a duplicate way with reference to the top plane creat- 
55 ing image or a combined image of the top plane creating 
image and the top plane converting image, thus it comes 
to be possible to grasp more easily the relationship be- 
tween relative positions to the obstacles. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0021] The foregoing and further objects, features 
and advantages of the invention will become apparent 
from the following description of the preferred embodi- 
ments with reference to the accompanying drawings, 
wherein like numerals are used to represent like ele- 
ments and wherein; 

FfG. 1 illustrates one example of a screen of a dis- 
play which is displayed at the time of one's own ve- 
hicle's moving back for driving column parking by 
way of a parking assist system of the present inven- 
tion; 

FIG. 2 illustrates one example of a screen of the 
display which is displayed at the time of inputting a 
parking target point and an avoidance point by way 
of the parking assist system of the present inven- 
tion; 

FIG. 3 illustrates one example of a screen of the 
display which is displayed at the time of finishing 
one's own vehicle's moving back for driving column 
parking by way of the parking assist system of the 
present invention; 

FIG. 4 is a flowchart of the parking assist system of 
the present invention; 

FIG. 5 is a block diagram of the parking assist sys- 
tem of the present embodiment; 
FIG. 6 illustrates each of the view range and the 
view point of a top plane converting image and an 
image taken by a CCD camera by way of the parking 
assist system of the present embodiment; 
FICY 7 illustrates nne AYamplA nf a picture ima«e 
taken by the CCD camera while one's own vehicle 
stops by way of the parking assists system of the 
present embodiment; 

FIG. 8 illustrates one example of a top plane con- 
verting image by way of the parking assist system 
of the present embodiment; 

FIG. 9 illustrates one example of a screen of the 
display in which the top plane converting image is 
incorporated with a part of the top plane creating 
image by way of the parking assist system of the 
present embodiment: and 

FIG. 10 illustrates displaying examples of the 
screen of a monitor display by way of a conventional 
"backward supervisory monitor device of an auto- 
mobile vehicle." 

DETAILED DESCRIPTION OF THE PREFERRED 

FMRnniMFMT 



[0022] The embodiments of the present invention are 
explained hereinafter with reference to the drawings. 
FIG. 5 is a block diagram of a parking assist system of 
the embodiment. The parking assist system of the 
present embodiment includes a microcomputer 2, a 
CCD camera 3, a steering angle sensor 4, a display 5, 



and a combination meter 6 as indicated in FIG. 5. 
[0023] At this point, the microcomputer 2 switches ON 
or OFF the CCD camera 3, and aiso outputs a picture 
image signal from the CCD camera 3 to the display 5. 
5 Further, the microcomputer 2 functions in accordance 
with a flowchart of FIG. 4, which is explained in the latter 
part of the specification, and corresponds to the "first 
calculating means/' the "second calculating means," an 
"image creating means," and an "image processing 

fo means" respectively. 

[0024] Further, the CCD camera 3 is mounted in the 
back portion of the vehicle, transforms a taken picture 
to a picture image signal, and then outputs it to the mi- 
crocomputer 2. At this point, the picture image which is 

*5 output to the microcomputer 2 is reversed in order to 
show on the display in the same way as to see back by 
means of a room mirror (mirror image). 
[0025] Further, the steering angle sensor 4 is mount- 
ed inside a steering wheel and detects a steering angle. 

20 Then, the detected steering angle is output to the micro- 
computer 2 as a steering angle signal. 
[0026] Further, the display 5 shows a picture image, 
which has been pictured by means of the CCD camera 
3, on a screen 7 through the microcomputer 2 and cor- 

25 responds to a "displaying means." The screen 7 is a 
touch panel and functions as the "first inputting means" 
and the "second inputting means." 
[0027] Further, the combination meter 6 detects the 
speed of the vehicle. Then ; the detected speed of the 

30 vehicle is output to the microcomputer 2 as a vehicle 
speed signal. Accordingly, it comes to be possible for 
the microcomputer 2 to calculate the distance of a mi- 

nrsatirm Ion nth 

• C7 

[0028] In the second place, the operation and function 
35 of the parking assist system of the present invention is 
explained based on the flowchart of FIG. 4. At this place, 
the case of column parking, in which one's own vehicle 
is parked in a space between a forward parking vehicle 
and a backward parking vehicle, is explained. There- 
to fore, for example, if one's own vehicle is stopped in the 
diagonally forward direction of the forward parking ve- 
hicle in order to park one's own vehicle in a column way, 
a back picture image 7A of one's own vehicle is dis- 
played on the left side of the screen 7 of the display 5 
45 as indicated in FIG. 2. At this stage, a bumper back end 
11 of one's own vehicle, a forward parking vehicle 12, a 
backward parked vehicle 13, and a road shoulder edge 
14 are displayed in the picture image 7A which is dis- 
played on the left side of the screen 7 of the display 5. 
so At this point, the fact that one's own vehicle has stopped 

\ , ^p i a,ri K y th r° vehicle s so o d sis s st »yu:~u ; ,.l 

the microcomputer 2 from the combination meter 6. 
[0029] Then, the parking assist system of the present 
embodiment judges whether or not an input of an avoid- 
55 ance point is made at step S11 of FIG. 4. At this point, 
the input of the avoidance point is made by touching di- 
rectly the left side of the screen 7 of the display 5. Then ; 
a marker G as the avoidance point is displayed using a 
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vertical line as indicated in FIG. 2. At this stage, when 
it Is judged that the input of the avoidance point has been 
made (S11 : YES), step S12 is performed. On the other 
hand, when it is not judged that the input of the avoid- 
ance point has been made (S11: NO), step S11 is s 
backed and the aforementioned judge is repeated. 

At this stage, the avoidance point (the marker G) 
is adjusted to the back end of the forward parking vehicle 
12 in FIG. 2. 

[0030] AtstepS12, it is judged whether or not an input 10 
of a parking target point is made. At this point, the input 
of the parking target point is made by touching directly 
the leftside of the screen 7 of the displays. At this stage, 
a marker P of the parking target point is displayed by a 
frame as indicated in FIG. 2. At this stage, when it is 15 
judged that the input of the parking target point has been 
made (S12: YES), step S13 is performed. On the other 
hand, when it is not judged that the input of the parking 
target point has been made (S12: NO), step S12 is 
backed and the aforementioned judge is repeated. In 20 
this place, in FIG. 2, the parking target point (the marker 
P) is adjusted in such a way that It can be parked in 
parallel with the road shoulder edge 14 in a space be- 
tween the forward parking vehicle 1 2 and the backward 
parking vehicle 13. 2 s 
[0031] At step S13, a parking path in which one's own 
vehicle reaches the parking target point by avoiding the 
avoidance point is calculated (referring to the 'first cal- 
culating means"). At this time, picture images displayed 
on the left side of the screen 7 of the display 5, the avoid- 30 
ance point which has been input at step S1 1 , and park- 
ing target point which has been input at step S12 are 
referred. 

In this pface, the meaning of the parking path of 
FIG. 2 is the path for parking one's own vehicle by avoid- 35 
ing the back end of the forward parking vehicle 12 and 
also arranging it in parallel with the road shoulder edge 
14 in a space between the forward parking vehicle 12 
and the backward parking vehicle 13. 

[0032] Further, after the parking path has been calcu- 40 
lated at step S1 3 it is judged whether or not the parking 
path exists at step S14. At this step, when it is not judged 
that the parking path exists (S14: NO), step S15 is per- 
formed, and "No parking is allowed" is displayed on the 
left side of the screen 7 of the display 5. Further, step 45 
S16 is performed, and the avoidance point which has 
been input at step S1 1 and the parking target point which 
has been input at step S12 are cleared, and then step 
S11 is backed. 

[0033] On the other hand, when it is not judged that so 
the parking path exists (S14: YES), step S17 is per- 
formed, an image of a top plane view which is seen from 
a higher point by means of computer graphics (referring 
to an "image creating means") based on the back picture 
image 7A (FIG. 2) of one s own vehicle which has been ss 
captured by the CCD camera 3 while one's own vehicle 
has been parking is created, and then a top plane cre- 
ating image 7B therefrom is displayed on the right side 



of the screen 7 of the display 5 as indicated in FIG. 2. 
At this point, the forward parking vehicle 12, the back- 
ward parking vehicle 13, the road shoulder edge 14, the 
marker G of the avoidance point, the marker P of the 
parking target point, the parking path S and so forth are 
displayed in a duplicate way in the top plane creating 
image 7B. 

[0034] Then, after the top plane creating image 7B 
has been created and displayed at step S17, step S18 
is performed, and then a mobile locus of the one's own 
vehicle is calculated (referring to the "second calculating 
means"). At this time, a steering rudder angle which can 
be obtained from the steering rudder angle signal which 
is output to the microcomputer 2 from the steering angle 
sensor 4 and a mobile distance which is calculated from 
a vehicle speed signal which is output to the microcom- 
puter 2 from the combination meter 6 are used. 
[0035] Then, at step S19, the mobile locus of one's 
own vehicle which is calculated at step S18 for the top 
plane creating image 7B on the right side of the screen 
7 of the display 5 is updated and then displayed. In FIG. 
2, since FIG. 2 indicates that one's own vehicle is parked 
in the diagonally forward direction of the forward parking 
vehicle 12, a current position X of one's own vehicle is 
only displayed in a duplicate way on the top plane cre- 
ating image 7B on the right side of the screen. 7 of the 
display 5 as the mobile locus of one's own vehicle. 
[0036] Further, at step S20, it is judged whether or not 
one's own vehicle has reached the parking target point. 
At this time, the picture image 7A which is displayed on 
the left side of the screen 7 of the display 5 ; the parking 
target point which is input at step S12, the mobile locus 
of one's own vehicle which has been calculated at step 
S18 and so forth are referred. In this place, when it is 
not judged that one's own vehicle has reached the park- 
ing target point (S20: NO), step S1 8 is backed, and the 
procedures after step S18 are repeated. 
[0037] To give an actual example, when column park- 
ing is made by one s own vehicle's moving back, the 
mobile locus of one's own vehicle is calculated again at 
step S1 8 and then the current position X of the top plane 
creating image 7B on the right side of the screen 7 of 
the display 5 is updated and displayed as indicated in 
FIG. 1 . Further, although the mobile locus of one's own 
vehicle is also updated and displayed, a parking path S 
and the mobile locus are duplicated with each other in 
FIG. 1 . However, the mobile locus of one's own vehicle 
and the parking path S are displayed using different 
colors and thus it is possible to identify by the top plane 
creating image 7B on the right side of the screen 7 of 
the display 5. 

[0038] Here, when column parking is made by one's 
own vehicle's moving back, the direction of the picture 
image 7A on the left side of the screen 7 of the display 
5 changes as the direction of one's own vehicle changes 
as indicated in FIG. 1 . At this time, an anticipated course 
of the one's own vehicle is calculated based on the 
steering rudder angle detected by the steering angle 
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sensor 4 and then an anticipated course R is updated 
and displayed on the picture image 7 A of the left side of 
the screen 7 of the display 5. 

[0039] On the other hand, when it is judged that one's 
own vehicle has reached the parking target point (S20: 
YES), the flowchart of FIG. 4 is ended. Such a case 
means that the column parking due to one's own vehi- 
cle's moving back has ended and then the screen 7 of 
the display. 5 is displayed as indicated in FIG. 3. 
[0040] As explained in the aforementioned explana- 
tion in detail, according to the parking assist system of 
the present embodiment, the picture image 7A in the 
back direction of one's own vehicle is displayed on the 
left side of the screen 7 of the display 5 by taking an 
image by the CCD camera 3 as indicated in FIGS. 1 to 
3. Then, the top plane creating image 7B, in which cir- 
cumstance conditions of one's own vehicle are indicated 
from a point of upward view, is created (S17 of FIG. 4) 
based on the picture image 7A (FIG. 2) in the back di- 
rection of one's own vehicle by taking an image by the 
CCD camera 3. 

[0041] On the other hand, as shown in FIG. 2, if the 
parking target point, in which one s own vehicle is pref- 
erably stopped continuously, is input by means of the 
touch panel of the left side of the screen 7 of diaplay 5 
through the marker P of the parking target point based 
on the picture image 7A in the back direction of one's 
own vehicle by taking an image using the CCD camera 
3 (S12 of FIG. 4), the parking path S from the current 
position of one s own vehicle to the parking target point 
is calculated (S1 3 of FIG. 4). Then, as indicated in FIGS. 
1 to 3, the parking path S of one's own vehicle is shown 
in the top plane creating image 7B In a duplicate wa w A n 
the right side of the screen 7 of the display 5, thus it 
comes to be possible to grasp the relationship between 
relative positions to obstacles such as the forward park- 
ing vehicle 12, the backward parking vehicle 13 : and the 
road shoulder edge 14. 

[0042] Further, according to the parking assist system 
of the present invention, the point, which one's own ve- 
hicle preferably avoids at the time of driving for parking, 
is input through the marker G of the avoidance point by 
means of the touch panel on the left side of the screen 
7 of the display 5 (S11 of FIG. 4), the parking path S 
from the current position of one's own vehicle to the 
parking target point is calculated by considering such 
an avoidance point at step S1 3 of FIG. 1 3, and the avoid- 
ance point, which one's own vehicle preferably avoids 
at the time of driving for parking, is considered in the 
parking path S, thus it comes to be possible to grasp the 
relationship between relative positions- to obstacles 
such as the forward parking vehicle 12, the backward 
parking vehicle 13, and the road shoulder edge 14. 
[0043] Further, according to the parking assist system 
of the present invention, the mobile locus of one's own 
vehicle is calculated from the steering rudder angle of 
one's own vehicle and the mobile distance of one's own 
vehicle (S1 8 of FIG. 4), the mobile locus is then shown 



in the top plane creating image 7B in a duplicate way on 
the right side of the screen 7 of the display 5, the mobile 
locus of one's own vehicle and the parking path S of 
one's own vehicle as well are shown in the top plane 

5 creating image 7B, in which the circumstance condition 
of one's own vehicle is indicated from a point of upward 
view, using different colors, and it is possible to identify 
the difference between the parking path S of one's own 
vehicle and the mobile locus of the one's own vehicle, 

10 thus it comes to be possible to grasp the relationship 
between relative positions to obstacles such as the for- 
ward parking vehicle 12, the backward parking vehicle 

13, and the road shoulder edge 14. 

[0044] Further, according to the parking assist system 

^ of the present invention, as indicated in FIGS. 1 to 3, in 
the top plane creating image 7B displayed on the right 
side of the screen 7 of the display 5, the current position 
X of one's own vehicle is shown in the mobile locus by 
being included, and it is possible by taking a look at the 

20 top plane creating image 7B to identify intervals among 
one's own vehicle and the obstacles (the forward park- 
ing vehicle 12, the backward parking vehicle 13, road 
shoulder edge 14, and so forth) and the angle of one's 
own vehicle to the obstacles (the forward parking vehi- 

25 cle 12, the backward parking vehicle 13, road shoulder 
edge 14, and so forth) at the moment, thus it comes to 
be possible to grasp the relationship between relative 
positions to obstacles such as the forward parking ve- 
hicle 12, the backward parking vehicle 13, and the road 

30 shoulder edge 14. 

[0045] Further, according to the parking assist system 
of the present invention, as indicated in FIGS. 1 to 3, in 

the SCreen 7 O f rho Hienlow R tho ni^titro imano 7A anrl 
r* j — i — » — •■ ■ — -^j — • • * — 

the top plane creating image 7B are displayed at the 
same time by splitting the screen, it is possible to see, 
with reference to the top plane creating image 7B, the 
picture image 7A (FIG. 2) for inputting the parking target 
point and the avoidance point and the picture image 7A 
(FIGS. 1 and 3) in which the anticipated course R cal- 
culated from the steering rudder angle of one's own ve- 
hicle is displayed in a duplicate way, thus it comes to be 
possible to grasp the relationship between relative po- 
sitions to obstacles (the forward parking vehicle 12, the 
backward parking vehicle 13, the road shoulder edge 

14, and so forth). 

[0046] At this place, the present invention is not limit- 
ed to the aforementioned embodiment of the present in- 
vention, but it is possible to apply to various modifica- 
tions within the scope of the purport. 
[0047] For example, although the parking assist sys- 
tQm pro^ ant em bodiment Is ex plained f or tho esse 
of column parking in which one's own vehicle is parked 
in the space between theforward parking vehicle 12 and 
the backward parking vehicle 1 3, the parking assist sys- 
tem of the present embodiment is capable of being ap- 
plied to the case of a garage (parallel parking). 
[0048] Further, in the parking assist system of the 
present embodiment, as indicated in FIG. 2, although, 
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based one the picture image 7 A in the backward direc- 
tion of one's own vehicle taken by the CCD camera 3, 
the parking target point in which one's own vehicle is 
preferably parked continuously is input by means of the 
touch panei on the left side of the screen 7 of the display 
5 through the marker P of the parking target point (S1 1 
of FIG. 4) and the avoidance point which one's own ve- 
hicle preferably avoids is input by means of the touch 
panel on the left side of the screen 7 of the display 5 
through the marker G of the avoidance point (S12 of 
FIG. 4), it may be possible to input the parking target 
point and the avoidance point by means of a switch 
working together with the marker P of the parking target 
point and the marker G of the avoidance point. 
[0049] Further, in the parking assist system of the 
present embodiment, as indicated in FIGS, 1 to 3, al- 
though the top plane creating image 7B which is shown 
in the right side of the screen 7 of the display 5 is created 
using computer graphics, it is possible to create a top 
plane converting image 7C (FIG. 8) by image-process- 
ing a back picture image 1 6 (FIG. 7) of one's own vehicle 
taken by the CCD camera 3 by means of the microcom- 
puter 2 (referring to an "image processing means") and 
then display it by incorporating the top plane converting 
image 7C (FIG. 8) to the top plane creating image 7B 
as shown in FIG. 9. 

[0050] In this place, the top plane converting image 
7C means that the back picture image 16 (FIG. 7) of one 
s own vehicle taken by the CCD camera 3 is converted 
to an image seen from a point of upward view V as 
shown in FIG. 6. At this point, as shown in FIG. 7, the 
bumper back end 11 of one's own vehicle, the forward 
parking vehicle 12, the backward parking vehicle 13, the 
road shoulder edge 14, and a traffic sign 15 of a road 
are taken in the back picture image 1 6 of one's own ve- 
hicle taken by the CCD camera 3. Due to the limitation 
of the view field of the CCD camera 3, however, the 
backward parking vehicle 13, the road shoulder edge 
14, and the traffic sign 15 of the road are taken in the 
top plane converting image 7C of FIG. 8, 
[0051] That is to say, as shown in FIG. 9, if the top 
plane converting image 7C is displayed by being incor- 
porated with the top plane creating image 7B on the right 
side of the screen 7 of the display 5, the top plane con- 
verting image 7C, in which a part of the top plane cre- 
ating image 7B in which the circumstance situation of 
one's own vehicle is indicated from a point of upward 
view is a real picture image, is obtained, thus it is pos- 
sible to display the top plane creating image 7B for 
grasping the relationship between relative positions to 
the obstacles (the forward parking vehicle 12, the back- 
ward parking vehicle 1 3, the road shoulder edge 1 4, and 
so forth). 

[0052] Further, it may be possible to display the top 
plane converting image instead of the top plane creating 
image 7B on the right side of the screen 7 of the display 
5 by creating the top plane converting image the size of 
which is the same as the top plane creating image 7B, 



not the aforementioned top plane converting imaqe 7C 
of FIG. 8. 

[0053] In this case, since the whole top plane creating 
image 7B in which the circumstance situation of one's 
5 own vehicle is indicated from a point of upward view is 
converted to the top plane converting image which is a 
real picture image : it is possible to display, as if the im- 
age is the real world, the top plane creating image 7B 
for grasping the relationship between relative positions 
10 to the obstacles (the backward parking vehicle 13, the 
road shoulder edge 14, and so forth). 
[0054] Further, in such a case, in the screen 7 of the 
display 5 : if the picture image 7A and the top plane con- 
verting image instead of the top plane creating image 
'5 7B are displayed at the same time by splitting the 
screen, it is possible to see, with reference to the top 
plane converting image instead ofthetop plane creating 
image 7B, the picture image 7A (FIG. 2), for inputting 
the parking target point and the avoidance point and the 
20 picture image 7A (FIGS. 1 and 3) in which the anticipat- 
ed course R calculated from the steering rudder angle 
of one' s own vehicle is displayed in a duplicate way, 
thus it is possible to grasp more easily the relationship 
between relative positions to the obstacles (the back- 
us ward parking vehicle 1 3, the road shoulder edge 1 4, and 
so forth). 

[0055] Further, in the parking assist system of the 
present embodiment, at step S1 7 of FIG. 4, although the 
top plane creating image in which the circumstance sit- 
so uation of one's own vehicle is viewed from a higher point 
of view based on the picture image 7A (FIG. 2) of the 
back portion of one's own vehicle which is taken by the 
CCD camera 3 while one's own vehicle is parking is cre- 
ated by means of computer graphics, it is possible, for 
35 this point, to modify the top plane creating image, dis- 
play the updated top plane creating image on the right 
side of the screen 7 of the display 5, and further display 
the parking path S of one's own vehicle in a duplicate 
way, based on the change of the picture image 7A due 
40 to the one's own vehicle's moving. In such a case, since 
the top plane creating image in which the circumstance 
situation of one's own vehicle is indicated from a point 
of upward view is replaced with the image correspond- 
ing to the current situation of one's own vehicle, it is pos- 
45 sible to grasp more easily the relationship between rel- 
ative positions to the obstacles such as the forward 
parking vehicle 12, the backward parking vehicle 13, 
and the road shoulder edge 14. 
[0056] In the parking assist system of the present in- 
50 vention, while the image creating means creates the top 
plane creating image, in which the circumstance situa- 
tion of one's own vehicle is indicated from a point of up- 
ward view, is created based on the picture image in 
which the circumstance situation of one's own vehicle 
55 is taken, since the parking path of one s own vehicle is 
displayed in the top plane creating image in a duplicate 
way by the displaying means after the first calculating 
means calculates the parking path from the current po- 
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sition of one's own vehicle to the parking target point if 
the parking target point, in which one's own vehicle is 
preferably parked, is input by the first calculating means, 
it comes to be possible to grasp more easily the rela- 
tionship between relative positions to the obstacles. 5 
[0057] Further, in the parking assist system of the 
present invention, when one's own vehicle moves, 
based on the change of the picture image due to one's 
own vehicle's moving, if the image creating means up- 
dates the top plane creating image and further if the dis- 10 
playing means displays the parking path of one's own 
vehicle in a duplicate way for the updated top plane cre- 
ating image, the top plane creating image, in which the 
circumstance situation of one's own vehicle is indicated 
from a point of upward view, is replaced with the image 15 
in accordance with the current situation, thus it comes 
to be possible to grasp more easily the relationship be- 
tween relative positions to the obstacles. 
[0058] Further, in the parking assist system of the 
present invention, if the first calculating means calcu- 20 
lates the parking path by considering the avoidance 
point which is input by the second input means, the park- 
ing path becomes the path in which the avoiding point 
which one's own vehicle preferably avoids at the time of 
driving for parking is considered, thus it comes to be 25 
possible to grasp more easily the relationship between 
relative positions to the obstacles. 
[0059] Further, in the parking assist system of the 
present invention, if the second calculating means cal- 
culates the mobile locus of one's own vehicle and further 30 
if the displaying means displays the mobile locus in a 
duplicate way for the top plane creating image, the mo- 
bile locus of one's nwn vehicle Is displayed In addition 
to the parking path of one's own vehicle in the top plane 
creating image in which the circumstance situation of 35 
one's own vehicle is indicated from a point of upward 
view and it is possible to recognize the difference be- 
tween the parking path of one's own vehicle and the mo- 
bile path of one's own vehicle, thus it comes to be pos- 
sible to grasp more easily the relationship between rel- 40 
ative positions to the obstacles. 

[0060] Further, in the parking assist system of the 
present invention, in the case that the displaying means 
displays the current position of one's own vehicle by be- 
ing incorporated with the mobile locus of one's own ve- 45 
hide, it is possible by taking a look to recognize the dis- 
tance from the obstacles at the present time to one's 
own vehicle and the angle of one's own vehicle towards 
the obstacles at the present time, thus it comes to be 
possible to grasp more easily the relationship between so 
relative p ositions to the obst ar% | QS- 
[0061] Further, in the parking assist system of the 
present invention, the image processing means for con- 
verting into top plane converting image in which said pic- 
ture image is viewed from a point of upward view is in- 55 
eluded, in the case that the displaying means displays 
the top plane converting image instead of the top plane 
creating image or displays by means of a combination 



of the top plane creating image and the top plane con- 
verting image, the image is converted into the top plane 
converting image in which the whole or a part of the top 
plane creating image in which the circumstance situa- 
tion of one's own vehicle is indicated from a point of up- 
ward view is a real picture image, it is possible to replace 
a part or the whole of the top plane creating image in 
which the circumstance situation of one's own vehicle 
is indicated from a point of upward view, thus it comes 
to be possible to grasp more easily the relationship be- 
tween relative positions to the obstacles. 
[0062] Further, in the parking assist system of the 
present invention, in the case that the displaying means 
displays the image as well as the top plane creating im- 
age at the same time by splitting the screen or in the 
case that the picture image and a combined image of 
the top plane creating image and the top plane convert- 
ing image are displayed at the same time by splitting the 
screen, it is possible to see the image for inputting the 
parking target point and the avoidance point and the im- 
age in which the, anticipated course calculated from the 
steering rudder angle of one's own vehicle is displayed 
in a duplicate way with reference to the top plane creat- 
ing image or a combined image of the top plane creating 
image and the top plane converting image, thus it comes 
to be possible to grasp more easily the relationship be- 
tween relative positions to the obstacles. 
[0063] A parking assist system for a driver to confirm 
a relationship between relative positions to obstacles 
and one s own vehicle. A top plane creating image 7B 
in which a circumstance situation of one's own vehicle 
is indicated from a point of upward view is created based 
on a backward image of one's own. vehicle taken Kw ° 
CCD camera and displayed on a screen of a display. A 
mobile locus including a marker G of one's own vehicle, 
a marker a parking path, and a current position is dis- 
played on the top plane creating image in a duplicate 
way. 



Claims 

1 . A parking assist system for displaying an anticipat- 
ed course calculated from a steering rudder angle 
of one's own vehicle on a picture image in a dupli- 
cate way in which a circumstance situation of one's 
own vehicle is displayed, comprising: 

image creating means for creating a top plane 
creating image based on said picture image in 

which said circumstance situation :c Indicated 

from a point of upward view; 
first input means for inputting a parking target 
point which one's own vehicle targets based on 
said picture image; 

first calculating means for calculating a parking 
path from a current position of one's own vehi- 
cle to said parking target point; and 
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2. 



displaying means for displaying said parking 
path on said top plane creating image in a du- 
plicate way. 

The parking assist system according to claim 1 , 5 
wherein: 

said image creating means updates said top 
planecreating image based on achange of said 
picture image caused by one's own vehicle's 10 
moving. 

The parking assist system according to claims 1 or 

2, wherein: 

15 

the system further includes a second input 
means for inputting an avoidance point which 
said one's own vehicle avoids and said first cal- 
culating means for calculating a parking path to 
said parking target point by avoiding said avoid- 20 
ance point 

The parking assist system according to claims 1 to 

3, wherein: 



5. 



the system further includes a second calculat- 
ing means for calculating a mobile locus of said 
one's own vehicle and said displaying means 
displays said mobile locus on said top plane 
creating image in a duplicate way. 

The parking assist system according to claim 4, 
wherein: 



25 



30 



The parking assist system according to claims 1 to 
5, wherein: 

said displaying means displays said top plane 
creating image and said picture image simulta- 
neously by splitting a screen. 

The parking assist system according to claims 6 or 
7, wherein: 

said displaying means displays said top plane 
creating image and said picture image or dis- 
plays said picture image and a combined image 
of said top plane creating image and said top 
plane converting image simultaneously by split- 
ting the screen. 



said displaying means displays a current posi- 35 
tion of said one's own vehicle by incorporating 
with said mobile locus. 

6. The parking assist system according to claims 1 to 

5, further comprising: 40 

an image processing means for converting to a 
top plane converting image in which said pic- 
ture image is viewed from a point of upward 
view and said displaying means displaying said 45 
top plane converting image instead of said top 
plane creating image. 

7. The parking assist system according to claims 1 to 

5, further comprising: 50 

an image processing means for converting to a 
top plane converting image in which said pic- 
ture image is viewed from a point of upward 
view and said displaying means displaying by 55 
means of a combination of said top plane cre- 
ating image and said top plane converting im- 
age. 
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